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Motivated by the polarization anomaly in the B — » 0(1020) A* (892) decay, we extend our search 
for other A* final states in the decay B° — > 0(1O2O)A*° with the A* — > A + 7r~ invariant mass 
above 1.6 GeV. The final states considered include the A*(1680)°, A|(1780)°, ^4(2045)°, and a 
AV spin-zero nonresonant component. We also search for B° — » 0D° decay with the same final 
state. The analysis is based on a sample of about 384 million BB pairs recorded with the BABAR 
detector. We place upper limits on the branching fractions B(B° — > (1680)°) < 3.5 x 10 -6 , 
-> 0A 3 *(178O)°) < 2.7 x lO" 6 , -> 0AK2O45) ) < 15.3 x 1CT 6 , and -> < 

11.7 x 10 -6 at 90% C.L. The nonresonant contribution is consistent with the measurements in the 
lower invariant mass range. 

PACS numbers: 13.25.Hw, 13.88.+e, 11.30.Er 



Recent measurements of polarization in rare vector- 
vector B meson decays, such as B — > cj>K* and pK*, have 
revealed a large fraction of transverse polarization [l], 0, 
B 0, @ ■ This indicates a significant departure from the 
expected predominance of the longitudinal amplitude Q . 
The rate, polarization, and CP measurements of B meson 
decays to particles with nonzero spin are sensitive to both 
strong and weak interaction dynamics and are discussed 
in a recent review [7J, |8| . 

In particular, the B — > <pK* decays are potentially 
sensitive to physics beyond the standard model in the 
b — ► s penguin transition, shown in Fig. [1] (a) [6] . The 
polarization anomaly in vector-vector B meson decays 
suggests other contributions to the decay amplitude, pre- 
viously neglected. This has motivated a number of pro- 
posed contributions from physics beyond the standard 
model In addition, there are new mechanisms within 
the standard model which have been proposed to address 
the anomaly, including new weak dynamics [l(J, such as 
annihilation or electroweak penguin, or strong dynamics 
such as QCD rescattering. 



In order to distinguish the models, the BABAR experi- 
ment extended the study of the B° — > (j>K*° decays with 
the tensor (J p = 2 + ), vector (J p — l - ), and scalar 
(J p = 0+) K*° @. The vector-tensor results are m 
agreement with quark spin-flip suppression [|| and Aq 
amplitude dominance, whereas the vector-vector mode 
contains substantial A + \ amplitude, corresponding to 
anomalously large transverse polarization, where A\ cor- 
responds to helicity states A = —1, 0, +1 of the <fi and K* 
mesons. 




FIG. 1: (a) Feynman diagram describing the B° — > (j>K*° 
decay; (b) definition of decay angles given in the rest frames 
of the decaying parents. 



In this paper, we extend our search for B° — > (j)K*° to 
the higher-mass and higher-spin resonances A"*(1680)°, 
AT 3 *(1780)°, and X|(2045)°. Charge conjugate reactions 
are implied throughout this paper. The respective quan- 
tum numbers for these states J p = l - ,3~, and 4 + are 
allowed in the K*° — > K + ir~ decay. Moreover, we extend 
our study of the B° — » (^(A^g decay, where (Kir)^ is 
the J p = + Kit component, to a Kit invariant mass up 
to 2.15 GeV. We also search for the decay B° — ► (j)D°, 
which is expected to be significantly suppressed relative 
to the observed B° — * ljD° due to a negligible uu + dd 
quark admixture in the <f> meson Q. 

The analysis follows closely our recent study [5j where 
we fully reconstruct the decay B° -> 0(1O2O)A'*° -> 
(AT + AT^)(A' + 7r _ ). The AT7T invariant mass rriK-n window 
is now moved to the range from 1.60 to 2.15 GeV to cover 
the above mentioned resonances. In Fig. [2] we show the 
rriK-n- distribution extended from our previous study in 
Ref. Q to the mass range from 0.75 to 2.15 GeV. 

The angular distribution of the B — ► <pK* decay can 
be expressed as a function of Tii — cos 6i and $ shown 
in Fig. Q] (b). Here 9i with i — 1, 2 is the angle between 
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FIG. 2: Distribution of the Kir invariant mass extended above 
1.6 GeV from the study of B° -» ^(A+tt") decays in Ref. [jj. 
The data distribution is shown with a requirement to enhance 
the signal as discussed in regard to Fig. [3] in text. The solid 
(dashed) line shows the signal-plus-background (background) 
expected distributions. The arrows indicate the higher mass 
range, 1.60 to 2.15 GeV, used in this analysis. 
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TABLE I: Fit results for each decay mode: the reconstruction efficiency £i ong and etrans obtained from MC simulation for 
longitudinally and transversely polarized events; the total efficiency e, including the daughter branching fractions |8J and 
assuming the smaller reconstruction efficiency; the number of signal events n a i g ; significance (S) of the signal; the branching 
fraction B; and the upper limit (UL) on the branching fraction at 90% C.L. The branching fraction B(B° — > 4>(K-K)g°) refers 
to the nonresonant J p — + Kit components quoted for 1.60 < ma < 2.15 GeV. The systematic errors are quoted last and 
are included in the S and UL calculations. The negative event yield (or B) for B° — > cj>K^(1780)° is extrapolated from the 
likelihood distribution in the physical range. 



Mode e long (%) e trans (%) e (%) n sig (events) S (a) B (KT 6 ) B UL (10" 6 ) 



^"•(1680)° 20.8 ±2.9 21.6 ± 3.0 2.64 ± 0.41 8±^.° ±11 0.6 0.7±J;? ± 1.1 3.5 

^J(1780)° 27.7 ± 2.0 28.2 ±2.1 1.71 ± 0.16 -6 ± 10 ± 7 0.0 -0.9 ±1.4 ±1.1 2.7 

0Jf|(2O45)° 23.6 ±2.1 24.5 ± 2.2 0.77 ±0.12 18±J| ± 12 1.2 6.0±^±4.1 15.3 

(j}{Kn)o° 34.8 ±1.6 11.42 ± 0.56 47 ± 16 ± 15 2.2 1.1 ±0.4 ±0.3 1.7 

<j>D° 33.1 ± 1.6 0.62 ±0.03 16 ± 7 ± 3 2.4 6.5l^±1.4 11.6 



the direction of the K meson from the K* — * Kir (9\) 
or </> — > KK (62) and the direction opposite the B in the 
K* or <fi rest frame, and $ is the angle between the decay 
planes of the two systems. For each decay mode, the 
differential decay width has three complex amplitudes 
A'l corresponding to the spin of the Ktt system J > 1: 



d 3 r 



dn 1 dn 2 d^> 



+1 



A=-l 



AlYXHx,$>)Y^(-H 2 



0) 



(1) 



where Yj are the spherical harmonics with J = 1 
for #*(1680), J = 3 for #1(1780), and J = 4 for 
#4(2045). The angular distribution is simplified when 
averaged over the azimuthal angle $ and becomes a func- 
tion of the fraction of longitudinal polarization f[ = 

\ A o\ 2 1 (\ A -i\ 2 + \ A o\ 2 + \ A +i I 2 )- Th e angular distribu- 
tion has only one contributing amplitude with J = A = 
for each 4>(Ktt)q and <pD final state. 

We use data collected with the BABAR detector [12| at 
the PEP-II e+e~ collider. A sample of 383.6±4.2 million 
Y(4S) — > BB events was recorded at the center-of-mass 
energy y/s = 10.58 GeV. Charged-particle momenta are 
measured in a tracking system consisting of a silicon ver- 
tex tracker with five double-sided layers and a 40-layer 
drift chamber, both within the 1.5-T magnetic field of a 
solenoid. Charged-particle identification is provided by 
measurements of the energy loss in the tracking devices 
and by a ring-imaging Cherenkov detector. 

We use two kinematic variables: AE = {EiEb — Pi • 
p B -s/2)A/i and m ES = [(a/2 + P* • Pb) 2 /E? - p|] 1 /2 ) 
where (Ei,pi) is the e + e~ initial state four-momentum, 
and (Eb, p_b) is the four-momentum of the B candidate. 
We require \AE\ < 0.1 GeV and m ES > 5.25 GeV. The 
requirements on the invariant masses are 1.60 < < 
2.15 GeV and 0.99 < m KE < 1.05 GeV. 

To reject the dominant e + e~ — + quark-antiquark con- 
tinuum background, we use event-shape variables calcu- 
lated in the center-of-mass frame. We require | cos#t| < 



0.8, where 9t is the angle between the B-candidate thrust 
axis and that of the rest of the event. We construct a 
Fisher discriminant, T that combines the polar angles 
of the B-momentum vector and the f?-candidate thrust 
axis with respect to the beam axis, and two moments of 
the energy flow around the -B-candidate thrust axis [l3| . 

We remove signal candidates that have decay products 
with invariant mass within 12 MeV of the nominal mass 
values for Df or D + — * 4>ir + . In about 8.8% of events 
more than one candidate is reconstructed and we select 
the one whose four-track vertex has the lowest % 2 . 

We use an unbinned, extended maximum-likelihood 
fit 0] to extract the event yields rij and the probabil- 
ity density function (PDF) parameters, denoted by C= 
{/li /£> ft} f° r tn e polarization parameters and £ for the 
remaining parameters. The data model has eight event 
categories j: B°_^ (/)(Kt:)* , <j)K*(1680f, 0#|(178O)°, 
</># 4 *(2045)°, (/>D Q , / (980)#*°, / (980)£>°, and combi- 
natorial background. The f {980)K*° and / (980)L>° 
categories are included to account for both the resonant 
and nonresonant K + K~ contribution in exclusive B de- 
cays, while the combinatorial background PDF is found 
to account well for both the dominant quark-antiquark 
background and the random tracks from the B decays. 

The likelihood Li for each candidate i is defined as 
d = TV rijVj(xi; C; where each of the Vj is the 
PDF for variables Xj= {AE, uies, m,K n , rn K ^, Tit, TI2, 
J-}. We do not allow CP- violation in the decay am- 
plitudes and ignore interference between the final states 
B — > (f>(Kir)j with different J because no significant sig- 
nal is observed. Since our acceptance in the decay angles 
is nearly uniform, the event yields are almost completely 
unaffected by interference among states of different J. 

The PDF V~j(~Xi\ C; £) for a given candidate i is a joint 
PDF for the helicity angles, and the product of the PDFs 
for each of the remaining variables. The helicity part of 
the exclusive B decay PDF is the ideal angular distribu- 
tion from Eq. Jl]) averaged over azimuthal angle where 
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H 1 H 2 

FIG. 3: Projections onto the variables AE (a), ttles (b), iriKi- (c), m K j^ (d), Tti (e), and H.2 (f) for the signal B° — > ^{K-k) and 
B° — > candidates. The solid (dotted-dashed) line shows the signal-plus-background (background only) PDF projection, 
while the dashed (long-dashed) line shows PDF projection for the sum of four B° -> 0(Kir) cate eories (for B° -> 0D°). The 
pronounced D° mass peak in (c) is predominantly due to background. The D^j-meson veto causes the sharp acceptance dips 
seen in (e). 



the amplitudes are expressed in terms of the polariza- 
tion fractions £, multiplied by an empirically-determined 
acceptance function Qi!H\- l 'H%) = Qi{H\) x Q^i^ii)- 

A relativistic spin-J Breit-Wigner amplitude parame- 
terization is used for the resonance mass d, [l4| , except 
for the nonresonant (-KV)q contribution which has no 
rriKTT amplitude dependence beyond the phase-space fac- 
tor. In the previous analysis with the Kir mass below 1.6 
GeV, we parameterized the (Kw)q itik-k amplitude with 
the LASS function dHH, which includes the K *(1430)° 
resonance together with a nonresonant component. How- 
ever, above 1.6 GeV the validity of the LASS parameter- 
ization is not certain and we use the phase-space model 
for the nonresonant (Kit)q parameterization. 

The parameters £ describe the background or the re- 
maining signal PDFs. They are left free to vary in the 
fit for the combinatorial background or are fixed to the 
values extracted from Monte Carlo (MC) simulation [l6| 
and calibration of £?-decay channels for the exclusive B 



decays. We use a sum of Gaussian functions for the pa- 
rameterization of the signal PDFs for AE, ihes, T , and 
of the D° meson ttik-k distribution. For the combina- 
torial background, we use polynomial functions, except 
for Toes and T distributions which are parameterized by 
an empirical phase-space function 17| and by Gaussian 
functions, respectively. The 4> and D° meson produc- 
tion can occur in the background, and we take this into 
account in the PDF. 

In the mass range 1.60 < m,K-n < 2.15 GeV, we 
do not find significant signal in any of the four decays 
B° -> cf>(K + ir-) with K* (1680)°, iq(1780) , #1(2045)°, 
or D° — > K + ir~ and we place limits on their branching 
fractions as shown in Table |TJ We see evidence for the 
nonresonant </>(_fT 7r)g° contribution consistent with ex- 
trapolation (33 events) from the lower mass range studied 
in Ref . [j| . Due to large correlation among various signal 
yields of the decay modes with broad Kir distributions, 
the errors on individual decay modes are relatively large. 



7 



However, the significance of the B° — > 4>(K + tt ) de- 
cay with (ifvr)S , X*(1680)°, #£(1780)°, and i^|(2045)° 
combined is larger than 5a. The significance is defined 
as the square root of the change in 21n£ when the yield 
is constrained to zero in the likelihood C. 

Since we do not determine the flavor of the neutral 
B meson, our limits refer to the sum of two flavor final 
states, such as 4>D° and (j)D°. We assume equal pro- 
duction of B + B~ and B°B° pairs in T(45) decays. In 
Fig. [3] we show projections onto the variables. Data dis- 
tributions are shown with a requirement on the signal-to- 
background probability ratio calculated with the plotted 
variable excluded. This requirement is optimized to en- 
hance the signal and results in signal selection efficiency 
between 60% and 90%. 

In the fit, we constrain both event yields and polariza- 
tion fractions // to the physically allowed ranges. The 
negative event yield in the B° — > 0X3(1780)° decay is 
obtained by using the likelihood in the positive event re- 
gion and fitting its shape with a parabolic function whose 
mininum is in the negative event region. For the three 
B° — > (f)Kj° decay modes with J > 1, the f[ fit results 
are consistent with any allowed value between and 1 
and we assume polarization which gives the smallest re- 
construction efficiency in the branching fraction calcu- 
lation. We integrate the likelihood distributions in the 
physically allowed ranges to compute the upper limits on 
the branching fractions. 

The nonresonant K + K~ contribution under the <fi is 
accounted for with the B° — > foK*° category with the 
broad fo invariant mass distribution [lij . Its yield is con- 
sistent with zero for any of the K*° spin assumptions. We 
find evidence for a nonzero event yield in this nonreso- 
nant K + K~ region under the with a D° of (31±|) 
events, with statistical errors only quoted. However, 
due to the broad K + K~ invariant mass distribution, we 
cannot distinguish between fo, do, or any other broad 
K + K~ contribution under the <fi. The uncertainties due 
to rn K x parameterization are estimated with variation 
of the shape model from the resonant fo to phase-space 
and account for the errors between 3 and 11 events in 
different channels. 

We vary those parameters in £ not used to model com- 
binatorial background within their uncertainties and de- 
rive the associated systematic errors between one and 
three events. The signal PDF model excludes the fake 
combinations originating from misreconstructed events. 
The biases from the dilution due to the presence of fake 
combinations, the finite resolution of the angle measure- 
ment, or other imperfections in the signal PDF model 
are estimated with MC simulation and generated sam- 
ples. This results in an uncertainty between 1 and 11 
events. 

Additional systematic uncertainty originates from B 
background, where we estimate that only a few events 
can fake the signal. The systematic errors in selection 



efficiencies are dominated by those in particle identifica- 
tion (4%), track finding (2%), and uncertainty due to the 
K* resonance parameters Q of 2-13%. Other systematic 
effects arise from event-selection criteria, <f>, K*°, or D° 
branching fractions Q, and number of B mesons. 

Our results place stringent limits on the B° — > (j)K*° 
branching fractions with the higher-mass and spin res- 
onances K*(W80)°, *T|(1780)°, and £7(2045)° when 
compared with the lower-mass states 0, 0, @| • The decay 
rate suppression may serve as an additional tool to study 
the mechanism of the anomalous transverse amplitude in 
the B -► (/-if* (892) decay. We find the B° -► (f>{Kir)*° 
rate with scalar (Ktt)q° to be consistent for Ktt invari- 
ant mass above and below 1.6 GeV. Our limit on the 
B° — ► 4>D° decay provides a test of the B decay mecha- 
nisms involving <f> mesons in the final state. 

In summary, we have searched for the B° — > <f>K*° 
decays with the tensor #1(1780)° and #1(2045)°, vector 
if* (1680)°, and scalar nonresonant (Kir)o° contributions 
with K*° — ► K + ir~ invariant mass above 1.6 GeV. Our 
results are summarized in Table U] We do not find signif- 
icant signal with the above resonances and place upper 
limits on these and B° — > (f)D° decays. 
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